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Abstract 


The main purpose of this paper is quite uncontroversial. First, we recall some models of analog computations (including 
these allowed to perform Turing uncomputable tasks). Second, we support the suggestions that such hypercomputable 
capabilities of such systems can be explained by the use of infinite limits. Additionally, the inner restrictions of analog 
models of computations are indicated. 
© 2005 Elsevier Inc. All rights reserved. 


1. Preliminaries 


Alan Turing clarified the notion of algorithm giving it a precise meaning as well as introduced a coherent 
framework for discrete computation. Soon, new results showing the relations of his model with other 
approaches, such as recursive functions (in the sense of Kleene) or Church’s /-calculus (for information about 
this subject, see Odifreddi [21]), originated in a natural way consistent theoretical basis to standard computa- 
tion theory. However, all these models use enumerable domains and treat time of computations as discrete. 

Nevertheless, computers need not have such qualities. Analog computers with the continuous internal 
states rather than discrete, as in digital computation, were invented and discussed quite thoroughly. Unfortu- 
nately, because of the problem of a coherent theoretical basis for analog computation and the fact that analog 
computers technology improved insignificantly in the second half of the last century, when compared with its 
digital counterpart, analog computation was about to be forgotten. For many reasons (new paradigms of 
computation, search for good tools for numerical analysis, new technologies) this situation seems to change. 

We may classify analog models as discrete time models (e.g., [1]) or as continuous time models. In this 
paper we are interested in the latter type. The basic model in this field is Shannon’s General Purpose Analog 
Computer [29]. The General Purpose Analog Computer (GPAC) is a computer whose computation evolves in 
continuous time. The outputs are generated from the inputs by means of dependences defined by a finite direc- 
ted graph (not necessarily acyclic) where each node is one of the following boxes. 


e Integrator: a two-input, one-output unit with a setting for initial condition. If the inputs are unary functions 
u, v, then the output is the Riemann-Stieltjes integral At - is u(x) dv(x) + a, where a and tọ are real constants 
defined by the initial settings of the integrator. 


E-mail address: Jerzy. Mycka@umces.lublin.pl 


0096-3003/$ - see front matter © 2005 Elsevier Inc. All rights reserved. 
doi:10.1016/j.amc.2005.09.074 


104 J. Mycka | Applied Mathematics and Computation 178 (2006) 103—117 


e Constant multiplier: a one-input, one-output unit associated to a real number. If u is the input of a constant 
multiplier associated to the real number k, then the output is ku. 

e Adder: a two-input, one-output unit. If u and v are the inputs, then the output is u + v. 

e Multiplier: a two-input, one-output unit. If u and v are the inputs, then the output is wv. 

e Constant function: a zero-input, one-output unit. The value of the output is always 1. 


u xk ku no] + —u+v 


v — 


A real constant multiplier unit An adder unit 
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Representations of different types of units in a GPAC. 


Although the above notion of GPAC seems fairly intuitive and natural, the accepted definition is due to 
Pour-El (see [23]). Let us now present a precise version of her definition for functions of one variable. In 
the following, J will denote a closed bounded interval with non-empty interior. 


Definition 1 [23]. The unary function y is generated by a GPAC on J if there exist a set of unary functions 


Vis>-++»¥n and a set of initial conditions y,(a) =y*, i=1,...,n, where a € J, such that, 
1. »=(y,---,y,) is the unique solution on J of a system of ODEs of the form 
A(x, 3) È = beP) (1) 


satisfying the initial conditions, where A(x, y) and b(x, y) are n x n and n x 1 matrices, respectively. Further- 
more, each entry of A and b must be linear in 1, x, Y1,- . <, Yn- 
2. For some 1 <i<n, y=y;on 1. 


3. (a,y;,---,)*) has a domain of generation with respect to the above equation, i.e., there are closed intervals 
Jo, Jis.. -, Jn (with non-empty interiors) such that (a,yj,...,j*) is an interior point of Jo x Jı x-+- x J, and, 
furthermore, whenever (b,z},...,2%) € Jo X J) X++- X Jy, there exist unary functions z),...,z,, such that, 


(i) z(b) =z; for i= 1,...,n; 
(ii) (Z1,-- - Zn) satisfy Eq. (1) on some interval 7* with non-empty interior such that b € I’; 
(iii) (Z},...,Z,) is unique on J”. 


The existence of a domain of generation indicates that the solution of the above equation remains unique 
for sufficiently small changes on the initial conditions. 

Let us recall that a function f(x) is differentially algebraic [25] if its derivatives satisfy a polynomial equation 
P(x,f(x),...,f(x)) =0 for some polynomial with rational coefficients. A function of several variables is 
differentially algebraic if it is a differentially algebraic function of each variable when the others are fixed. 
Provided with the above definition, Pour-El shows the following result. 


Theorem 2 [23]. If y is generable on I by a GPAC, then there is a closed subinterval I' C I with non-empty 
interior such that on I’, y is differentially algebraic. 
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Another important model of analog computation is Rubel’s Extended Analog Computer (EAC) [27]. This 
model is similar to the GPAC, but we allow other types of units and several independent variables because 
Rubel does not seek any equivalence with existing models. The EAC permits all the operations of ordinary 
analysis, except the unrestricted taking of limits. The new units add an extended computational power rela- 
tively to the GPAC. 

The EAC works on a hierarchy of levels, getting more versatile as one goes to higher levels in the hierarchy. 
At the lowest level 0, it produces and manipulates real polynomials of any finite number of real variables. The 
EAC has no inputs from outside, but it has a finite number of settings (arbitrary real numbers). The settings 
determine behavior of the machine from the first level through all subsequent levels. The EAC has outputs and 
we demand them to be real analytic. The outputs at level n — 1 can be used as inputs at level n. The EAC sat- 
isfied the condition that when inputs at some level are modified by small errors then the outputs differ from the 
original output only by a small amount on each compact set. 

At each level, the actual computing is done by some boxes of different kinds. First, there are the constant 
boxes, which produce arbitrary real constants. There are projection boxes, which produce any of variables 
X1,.--,X,. Later, there are adders, multipliers and substituters (for given v,u,...,uz they give v(uy,...,U,) as 
the output). Moreover, there are inverters, which for given fi,..., fy: R"'* — R find real analytic functions 
Yis- -- Ve Of X1,...,X, such that for all 1 < i < k we have f(x1,...,Xn,V1,---,Vx~) = 0. We have differentiators, 
that for any function produce desirable mixed derivatives. Certain sets in Euclidean space are produced by the 
machine for a given function f, namely {(x1,..-,X%n) :f(X1,---;Xn) > O} or {(X1;. -3 Xn) : AXi- - -3 Xn) > 0}. Then 
there are the analytic continuation boxes, which produce a unique analytic continuation for given function and 
domain. 

The quintessential box is the boundary-value problem box, which solves a finite set of partial and ordinal 
differential equations on the given set with certain bound and boundary values prescribed. For some given 
function f and set Q with the given boundary we can also use restricted limit box, which defines ọ 
(x) = lim, x yeof0). 

Using the results from [25,27] we can formulate the following statement. 


Proposition 3 [27]. The set of GPAC-computable functions is a proper subset of the set of EAC-computable 
functions. 


For example, the EAC can generate the T- and ¢-functions (it is known that the GPAC cannot solve these 
problems [25]). It is not known if a physical version of the EAC exists. 

A new approach was given by Moore in 1996. In the work [13], he defined a set of (vector-valued) functions 
on the reals (called R-recursive functions) in the analogous way to the classical recursive functions on the nat- 
ural numbers. His model has also a continuous time of computation (a continuous integration instead of a 
discrete recursion). Moore’s seminal paper gave rise to a further development in real recursive function theory 
(in spite of some problems with his definition and results). 

In [18] one can find the definition, which is a derivative of Moore’s original formulation, introduced to 
avoid problems involved in the latter. It is important to see that the following definition is based on the vector 
operations. 


Definition 4 [18]. The set of real recursive vectors is generated from the real recursive scalars 0, 1, —1 and the 
real recursive projections //,(x1,...,X,) =x; 1 <i<n, n> 0, by the operators: 


1. Composition: if f is a real recursive vector with n k-ary components and g is a real recursive vector with 
k m-ary components, then the vector with n m-ary components (1 <i < n) 


AX +++ Xm filis -Xma -a Bg -a Xm) 


is real recursive. 

2. Differential recursion: if f is a real recursive vector with n k-ary components and g is a real recursive vector 
with n (k +n + 1)-ary components, then the vector h of n (k + 1)-ary components, which is the solution of 
the Cauchy problem for 1 <i < n 


hi(xı, oe „Xk, 0) = fix, TE Xk); 
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Ohya eg MEN) = 8 (Migsas Xk Y, M X1, -Xk Y) cyl Otneee RED) 


is real recursive whenever A is of the class C' on the largest interval containing 0 in which a unique solution 
exists. 

3. Infinite limits: if f is a real recursive vector with n (k + 1)-ary components, then the vectors h, h’, h” with n k- 
ary components (1 < i < n) 


hi(xı, oe Xe) = Tim fi(%1, suis ies); 
h(x,- Xp) = liminf f(x,- <., Xk, V), 
yoo 


hi (x1, ..., X4) = lim sup fim, ... , Xk, Y), 


y>% 


are real recursive in the domain containing these points, where these limits exist for all 1 < i < n. 
4. Arbitrary real recursive vectors can be defined by assembling scalar real recursive components. 
5. If fis a real recursive vector, then each of its components is a real recursive scalar. 


From the physical point of view with such a definition we are ready to use only a finite amount of energy. 
The possibility of operations on undefined functions is excluded here: our functions are strict in the sense that 
for undefined arguments they are also undefined. But to obtain some interesting functions we should improve 
the power of this system by the use of the operators of infinite limits. Let us point out that introducing of infi- 
nite limits gives discontinuous functions. We should also remember that in some cases we can use limits in 
some real point. This is possible by transforming them into infinite limits. For example, lim,_.2 sin xy can be 
written as lim,_., sin x(arctan y). i 

To illustrate further this transformation let us point out that if fis a (n + 1)-ary real recursive function, then 


its derivative 0,f(x1,...,%n,¥) = limy..@(f (x1, .-- 5%, Y +4) — f (X1, ---,Xn,y)) is a real recursive function, 
whenever such a limit exists. For example, if we take Ay-I/y then lim,..(1/(y++)—-1/y)o= 
lim,,...0(y — y — 4)/[(vy + 4)y] = —1/y’ is a real recursive function. Derivatives are physically realizable: the 


class of differential algebraic functions is closed under derivatives, making a large class of derivatives physi- 
cally realizable. 


2. Properties of analog computation by means of real recursive functions 


Now we can consider a new problem. Are there different levels of difficulty in a computation if it goes in the 
analog way? The natural measure of a function difficulty can be joined with the degree of (dis)continuity. The 
above considerations lead us to the conception of the 7-hierarchy which describes the level of nesting limits in 
the definition of a given function. 

Syntactic descriptions of real recursive vectors are needed to formulate a precise definition. Some kind of 
symbols called basics descriptors are introduced for all basic real recursive functions. The combination of such 
descriptions for given real recursive functions will form a new description of another function. For basic func- 
tions we can propose: i is a k-ary description for projection EÉ forall 1 <j < k; 1x, Ip, 0; are k-ary descriptions 
for constants 1, —1, 0 used with k variables. We must also add operator symbols (descriptors) for all intro- 
duced operators: dr-for a differential recursion, c—for a composition, /, /s, li—for a respective kind of limits 
(lim, limsup, liminf). 


Definition 5 [18]. The collection of descriptors of real recursive vectors is inductively defined as follows: 


e i is a n-ary description of F, 1 <j<ne€N; 1, is a n-ary description of f(x,,...,xX,) =1; I, is a n-ary 
description of f(x1,...,X,) = —1; 0, is a n-ary description of f(x1,...,X,) = 0; for all (x1,...,x,) E€ R”, n € N; 
e if (h) = (hy,...,Am) is a k-ary description of the real recursive vector A and (g) = (gj,...,g,) is a n-ary 


description of the real recursive vector g, then c((/),(g)) is a n-ary description of the composition of h 
and g; 
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e if (h) = (hy,...,h,) is a k-ary description of the real recursive vector h and (g) = (g),...,8n) isa(k +n-+ 1)- 
ary description of the real recursive vector g, then dr((/), (g)) is a (k + 1)-ary description of the function 
defined by differential recursion; 

o if (h) = (hy,...,hm) isa (n + 1)-ary description of the real recursive vector h, then (((h)), li((A)), Is((h)) is a n- 
ary description of an appropriate infinite limit (respectively lim, liminf, limsup) of h; 

e if (fi)... (fm) are n-ary descriptions of real recursive k-ary scalar functions fi, . . fm, then v((f1),.-., fmn) is 
a k-ary description of the real recursive vector f= (f{,...,fin)- 


At the moment we can define the y-number for a description of some real recursive function f. 


Definition 6 [18]. For a given n-ary description s of a vector function f let E*(s) (the y-number with respect to 

ith variable of the k-component) be defined as follows: 

1. E1(0,) = E!(1,) = E! (1,) = 0; 

2. El (c(h), (8))) = maxi <jce (EF ((A)) + Ei((g;)))s where A is a n components k-ary vector and g is a k-compo- 
nents m-ary vector; 

3. for a differential recursion we distinguish two cases: 


e i<k: 


Ei(dr((f), (g))) = max (E; (A) -s E (fa), Ei UE) «+ E UE) Era E) +> Era (En). 
e i=k+1: 


E;(dr((f), (8))) = max (max (Em1 ((81)); -s Etim (8n))))> 


O<m<n 


where f is a n components k-ary vector and g is a n components (k + n + 1)-ary vector; 
4. E(1((h))) = EX(li((h))) = EX(Is((A))) = max (E$ ((h)), EX, ((h))) + 1, where h is a k components (n + 1)-ary 
vector. 


The main idea of the above definition is to count nested limits in descriptions. In point (3) we should dis- 
tinguish the case i= k + 1 (differential recursion is given with respect to this variable); in this case (f) is not 
important for the counting. 

For the n-ary description s of m components we can define now E((h)) = max,max,E*((h)) for 1 <i<n, 
1 <k <m. Now we can deal with the y-number for a real recursive function. 


Definition 7 [18]. For a given real recursive function f, let n(f) be defined as the minimum of E((/)) for all 
possible descriptions of the function f. 


We are ready to conclude with the definition of the y-hierarchy as a family of H; = {f : n(f) < j}. It will be 
comfortable to think about the y-hierarchy as a measure of the difficulty of real recursive functions. If f € H, 
then j nested limits is used to define f. However we can patch functions defined by infinite limits, so j can be 
seen as the number of nested (non-parallel) n needed to patch the function f to the total function. Hence, as 
another equivalent definition we can suggest the following: if fis a real recursive function, then E(f) =j if at 
most j nested 7 operations are necessary to create fiotaı Such that fiotar is everywhere defined and if f (Xo) is 
defined, then fioa (Xo) = f (Xo). 

Let us illustrate the above part of the text with some examples. 


Example 8. The functions +, x, —, exp, sin, cos, Ax - L, /, In, Axy-x” are real recursive functions from Hp. The 
Kronecker 6-function, the signum function, absolute value, the Heaviside function 0, the binary maximum 
max, the square-wave function s and the floor function are in Hj. 


Let us give the examples of some functions which are significant in mathematics and can be expressed in 
terms of real recursiveness. 
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Example 9. The Bessel functions of the first kind J, of order v (integer) are real recursive functions of the class 
Ho. The Euler’s I -function and the Riemann eared are real recursive functions from the class H4. 


Let us comment briefly Euler function: T(x) = h č exp(—t)dt. It is simple to observe T(x) = 
limy 00 ie -l exp(—s)ds. Because s*~'exp(—s) is : real recursive function and fos ‘exp(—s)ds is in Ho 
hence T is in H4. 


Proposition 10 [18]. The class of real recursive functions is a proper superset of the class of GPAC-computable 
functions. 


The above proposition is obvious considering our results that I Euler function and ¢ Riemann function are 
real recursive functions and the result of Marion Pour-El [23] that these functions are not GPAC-computable. 
For the proper analysis of functions it is important to control the domain and singularities of functions. We 
can postulate new operators which may check the points: are they in the domain of some functions or not. 


Definition 11 [18]. For any function f : R"+! — R let 
1 if lim f(x,y) exists, 


0 otherwise. 


nyt (X,Y) = 


The definitions of ni, and 1, are given by a replacement of lim by liminf and limsup, respectively, in the above 
equation. 


Defined in this way 1,,f (x,y) is a characteristic function for the set of such x that lim, f(x,y) is well 
defined’ (without singularities). Analogously, 1),f(x,y), mf(x,y) play the same role, respectively, for 
lim inf,_...f (x,y), lim sup,_,..f(%,y). The problem arises whether such operators are real recursive operators. 
If the answer to this question is ‘yes’, we may patch any partial function to a total one. For example, let the 
function f be total and Fiorai (¥) = lim, (nf ©, y) F(X, y), F(x) = lim, f(x,y). The function Fora (x) is total 
and has such a property that if F (x) is defined, then Fjota1(x) = F(x). For points which are not in the domain of 
F we have Fiota(x) = 0. 


Proposition 12 [18]. The functions n,g, nig, ng are total real recursive functions if g is a total real recursive 
function. 


Now we can turn to some application of the y-operator. We consider a possibility of a process of Turing 
machines simulation by real recursive functions. 

Let us consider a Turing machine given by the following description. It consists of an infinite tape for stor- 
ing the input, output, and scratch working, and a finite set of internal states. All elements on a tape are strings. 
Without any loss of generality, we can choose some alphabet for these strings, the binary alphabet is a prac- 
tical choice. The machine works in steps. At one step it scans the symbol from the current position of the tape 
(under the head of the machine), changes this symbol according to the current state of the machine and moves 
the position of the tape to the left or right with a transformation of state. Some states are distinguished as 
final, when the machine reaches one of them, then it stops. Our Turing machine model obeys to the classical 
constraints: (a) input is finite and (b) output is finite, regardless of the computation length. 


Proposition 13. There are real recursive functions from the class H,, which can simulate any Turing machine, 
ie., for a machine M there exists a real recursive function fy : R? — R? such that for the initial tape and state 
encoded into (x,y) the nth iteration fi; (x,y) gives the codes of the tape and state after n steps of Turing machine. 


It can be mentioned that the process of simulation is especially important for universal Turing machines. 
The results in this area proved last year (e.g., [24]), give us the interesting restrictions of the size of such 
machines (for example, there exists a universal Turing machine for 5 states and 5 symbols) which leads us 
to a significant simplicity of the constructed function. It is worth pointing out that fọ can be analytical 


(see [10]). 


' Whenever we say that lim, limsup, liminf are defined, we want to say that they belong to R. 
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Let us signal a few important questions concerning Turing machines. The first problem is known as the 
halting problem: does the machine M for input (x,y) reach the final state? There is not a natural recursive 
characteristic function of this problem. The method of simulation of Turing machines given above can resolve 
it in the simple way with real recursive functions. 


Proposition 14 [18]. For any Turing machine M, there exists a real recursive function which is the characteristic 
function of the halting problem for M. 


Proof. We can define F! (x,y,z) = fi) (x,y), then let 
Hy (x,y) = (1-F uŒ ¥,2))A (lim (n-F u (Œ, y, 2)) ` Fux, y,z)), 
where A(x, y) = 1 if the state written in x is final (accepting), 0 otherwise. The function A(x, y) can be defined 


as zarn lents s — na). The function Hy, is a real recursive characteristic function of the halting 
problem for the machine M. 


To obtain the function computed by M, it is enough to iterate the steps up to reaching the final state by the 
machine. If the machine M ends in the final state for some tape (x,y), then there exists such mo € N that the 
sequence f; (x,y) is constant for n > mo. We can define the function Fy(x, y) computable by M as 

Fu(x,y) = lim [fy (x,y) x g(A(lim (n-F y(x, y,2)) -Fu (2 y,2)))), 
where g is a function not defined at 0, otherwise it takes value 1 (for example given as lim,_.., ae Then 
Fm 1s defined whenever lim exists and the value of the function A is 1 (i.e., the Turing machine M reaches for 
the initial tape (x,y) the final state), otherwise is undefined. 

Let us turn for a moment into the problems of computation beyond the power of Turing machines. The 
problem of infinity, which can appear in the sequel of not finishing computation, introduced problems into 
the computability theory and practice. The first step to improve this situation is directed to change the behav- 
ior of a Turing machine. For this purpose we may use an accelerated Turing machine [5]. Its description is the 
same as for a standard Turing machine, but a temporal pattern of steps is given. Each subsequent step is per- 
formed in half the time of the step before. Such machines could complete an infinity of steps in two time units 
only. This feature of accelerated Turing machines gives us the power to puzzle out the halting problem by pro- 
gramming the following algorithm: mark the first square on the tape by 0, change it only in the final (last) step 
to 1, if after 2 time units we have 0 in the distinguished square, then machine does not halt, otherwise it halts. 
However, some difficulties arise also in this model. Let us imagine the machine changing value of one square 
from 1 to 0 and, conversely, in all steps using only one non-final internal state. We can hesitate what is on the 
tape after all steps (in infinity) because in this case the computation diverges. The accelerated Turing machine 
can be simulated in the same way as the standard Turing machine with only one modification: in the definition 
of Fy(x, y) it is not necessary to have the result (z,,z,) with a final state 7 written in z,. Hence, the convergent 
infinite computations and finite computations both give the correct result, however the divergent computa- 
tions have an undefined result. As we can observe, real recursive functions are quite a powerful tool of a 
description for this problem of infinite computation. 

The above remarks prove that y-operator gives us an additional power to standard models of computation 
by controlling the domain of computable functions and machines. Such possibility is an effect of checking in a 
finite amount of time an infinite number of computation elements. 

At this moment we can generalize our considerations from the notion of Turing machine up to a wider 
characterization of computability. We will proceed with the relations of natural numbers taken from the arith- 
metical hierarchy. The class X9 = M9 contains only such relations which have recursive characteristic func- 
tions, i.e., which can be computed by Turing machines. The upper stages of this hierarchy can be 
constructed from the lower ones in the following way: 


X? a = {P: (EP'e II?) P(m) = AsP’(m,s)}, 
IT, = {P : (AP’ € 2°)P(m) = VsP'(m,s)}, 
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where P C N*, P'C N*"!, k > 1. To complete our hierarchies we can add the following equation A° = 
XZ? nI, n= 0. 

The importance of the arithmetical hierarchy is connected with many fields. It can be observed as a kind of 
formal description of definability (see [21]). Its classes can be used to classify a complexity of mathematical 
notions (e.g., the definition of a limit of sequences is of ITS class). From the computability theory point of view 
we can see the arithmetical hierarchy as the levels of natural functions (given by their graphs) which are dif- 
ferent in quantity of infinite ‘while’ loops necessary to their computation. Also linguistic problems of computer 
science can be expressed in terms of this hierarchy. The most known example is the one of the classes of recur- 
sive (X9) and recursive enumerable (Z?) languages. In some sense we can also see this hierarchy as a measure of 
uncomputability of functions (or undecidability of relations). Especially, the halting problem is known to be 
= 

We are interested in a correlation of this infinite hierarchy of sets and relations to the y-hierarchy. Going to 
infinity with n for the function fy and using the fact that all recursive sets and relations have Turing comput- 
able total characteristics, we get the following conclusion. 


Corollary 15 [18]. Every recursive set or relation (with argument from N) is in Ao, i.e., z = TI C A». 
For the rest of the arithmetical hierarchy we have the following result. 


Theorem 16 [18]. The sets and relations from X°, TI? belong to Hisz for i > 0. 


re 

This fact does not mean that a better real recursive restriction for the arithmetical hierarchy does not exist. 
Let us analyze one aspect of the analytical hierarchy. This hierarchy exceeds strongly the arithmetical one. We 
can deal with especially important class JT}. Let us mention that I! sets can be uniformized by sets of the same 
class. Moreover, for any n € N the classes Z° and I? are subsets of IT;. The class of I} relations is defined by a 
function quantifier used on an arithmetical relation: R € N**! is I! if R(x, y) = (Vf : N > N)O(X, f(y)), where 
Q is from some level of the arithmetical hierarchy. 


Proposition 17. Any relation R € TI! is in He. 


The levels of the analytical hierarchy and their relation to the y-hierarchy can be analyzed with the y-oper- 
ator like in [13]. Because the y-operator may be replaced by infinite limits (see [15]) the remaining part of the 
analytical hierarchy can be obtained in this way. 


3. Real functions computable by Turing machines 


Let us change our approach. From now on we will use only classical computational devices like Turing 
machine. To define real functions computable by such machines we have to consider a way of an approximation 
of real numbers by natural ones. This method is well known (e.g., [9]), here we use an approach such as in [34]. 

Let us present the method of a connection of real computations with Turing machines. The first step is 
devoted to some coding of rational number (from Q) into natural numbers. We use Cantor pairing function 
i,j) = DDt and inverses 7,((i,j)) = i, n((i,j}) =j. Of course, we can extend this for more arguments: 
(i j,k) = (i, (j,k). It is possible to define an effective numbering vg: N — Q such that vo(n) = for 
n= (i,j,k). A function f : N* — Q is called computable iff f (nı, ..., ny) = vo(g(m,...,nx)) for some function 
g : N* — N computable by Turing machine. 

The next step is connected with computable sequences of real numbers. A sequence (x,,),,-,, Of real numbers 
is computable in this sense if there is computable (in the sense of the previous paragraph) double sequence 
(Tnm)nmen Of rational numbers which converges uniformly and effectively to (x,) namely there is a Turing 


computable function e : N? — N such that 
(Vn,m,k E€ N)(k > e(n,m)) > |ryag —X,| < 27”. 


neN? 


Let us explain that the above definition can be expressed in such an informal way: the sequence of real num- 
bers is computable if there exists such a Turing machine that for the given index n of some element of this 
sequence and for the given precision 2°” this machine computes the code of such rational number r, which 
differs with x, less than 2”. 
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At the last step we would like to define a real function, which can be approximated by Turing machine. We 
want to have the following intuition preserved—if a given rational argument is in the known neighborhood of 
x then the Turing machine gives rational number in the known neighborhood of f(x). Moreover, we should 
have a possibility to decide by some parameter how small is the neighborhood. 

So we would like to have for a function fan effective procedure which uses a Turing machine M; for a given 
precision n and for a given sequence r, (produced by another Turing machine) convergent to x, this proce- 
dure finds such mo, ko that Ms (Fm) =q and |q — f(x)| < 2”. 

With this intuition we can give the definition of computable real functions, here in the sense of functions 
approximable by Turing machines. 


Definition 18 [34]. A real function f : [a,b] — R is called computable, if f maps every computable sequence 
(Xn) ncn Of real numbers to a computable sequence (f(xn)) en and there exists a recursive function d : N — N 
such that 


(Vx,y € [a,b]) (Wa € N)[x—y| <2 — |f(x) —f)| <2. 


Such definition gives us quite different look at the problem of computability over the reals. Here we restrict 
the set of real functions in such a manner, that we consider only functions, which can be approximated effec- 
tively by Turing machines. In this sense they are physically computable by digital computers, because we can 
always find as the result a rational number near to the original value of a function with any desirable precision. 
Such functions cannot be treated as any instance of hypercomputation. Let us point out that e, z are real com- 
putable, that means we have a method to a rational number in any neighborhood of them; Chaitin’s Q is not 
real computable in this sense. 


4. GPAC and Ho versus Turing machines 


We introduce a simple concept—by an analogy with the recursive functions of Kleene, whenever a function 
is defined only with composition and differential recursion (f € Ho), we call f a primitive real recursive 
function.” 


Proposition 19 [18]. Every primitive real recursive function f defined on the closed domain D € R" is GPAC- 
computable. 


However, let us point out that there are functions (like 2x: |x| in the interval [—1,1]), which are bounded 
with their derivatives but they, or some of their derivatives, are not continuous (and not primitive real recur- 
sive ones). 

We can observe that the model of analog computation given by real recursive functions includes GPAC- 
computable functions. 


Theorem 20 [18]. Every GPAC-computable function with real recursive numbers as parameters is a real 
recursive function. 


Now let us do the first step to analyze when some functions generated by analog computation are beyond 
the Turing limits of computations. Of course, real computable functions described in the previous section are 
under this limit. But what is the situation of GPAC-computable functions? This question is additionally 
important because, as we can observe from the above propositions, GPAC-computable functions form the 
basic level of analog computations, which is a common part of EAC-computable functions and real recursive 
functions. 

The answer can be found in Rubel’s paper [26], where the following theorem (in the slightly different for- 
mulation) is proved. 


? There is a slight difference since (classical) primitive recursive functions are always total and primitive real recursive functions can be 
partial. 
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Proposition 21 [26]. For any GPAC with a locally unique solution, which is analytical on an open interval I 
containing 0 with an analytical output f, if all the constants are rational numbers, then there is an open subinterval 
0€JCI, on which f is digitally computable. 


In [26] the phrase ‘fis digitally computable’ means that there is a uniform algorithm for producing polyno- 
mials p„ with rational coefficients such that |p, (x) — f(x)| < 4 for all x € J. It is simple to observe that this con- 
dition can be transformed into conditions satisfied by real computable functions in the sense of Definition 18. 

Now, we can consider another important case of analog computation. Let us look closer at the primitive 
real recursive functions, i.e., at the class Ho. All functions from this class are GPAC-computable by Proposi- 
tion 19. From these results we have a corollary that all primitive real recursive functions are real computable. 
We can also obtain the same result by the following observation. The basic functions (constants and projec- 
tions) are real computable. Composition of two real computable functions is also real computable. Hence, the 
only one not obvious case is a definition by differential recursion. However, an integration used by this oper- 
ator can be approximated by some kind of numerical integration with a control of a precision, which gives us a 
real computable solution. So, we have the corollary. 


Corollary 22. Every primitive real recursive function can be approximated by Turing machines. 


The above results teach us that analog computation in some cases does not increase the computational power 
beyond Turing border. This is not sufficient (as it is sometimes suggested) to use real numbers to cross restric- 
tions of Turing computability. Of course, the precise comparison of Turing and analog computability depends 
on a detailed analysis of all operations allowed in the discussed models. 


5. What can us take beyond the Turing limit? 


Let us try to enumerate some examples of hypercomputational properties of analog computation and to 
find the common elements. 

Moore in his paper [13] proves the theorem that the halting problem is solvable by R-recursive functions 
if we allow to use the zero-finding y-operator. However, we can avoid the use of this, somehow unnatural 
for the analog world of mathematical analysis, operator. The good choice seems to be guaranteed by infinite 
limits. 


Theorem 23 [15]. If f(x,y): R"! > R is a real recursive function then the function g:R" — R, g(x) = 
uf (x,y) is real recursive too. 


Hence, we obtain a corollary that the halting problem can be solved by real recursive functions, when we 
use infinite limits in the solution. The same fact, by a different method, is given in our Proposition 14. 

Let us discuss briefly another analog device. It is an open problem whether EAC can be simulated by Tur- 
ing machines (in general, by digital computers). However, this is a known fact that EAC is stronger that 
GPAC and it can compute some difficult functions (e.g., IT -function, ¢-function). We can observe that these 
properties are connected with infinite limits, namely the proofs of EAC-computability for such functions 
use the mentioned operation. It would suggest that the power of EAC is strongly connected with limits incor- 
porated in its structure. 

In the classical framework we can create uncomputable functions (relations) extending the set of Turing 
computable functions to the whole arithmetical hierarchy. As a consequence of the definition of this hierarchy 
we find unrestricted quantifiers as tools leading toward uncomputability. Hence, we need to analyze the 
method of quantifiers usage. 

For every function f: R"™! — R we can construct such a real recursive function pr: R” — R that 


of Jy € Nf (Z, y) = 0, 
PATELO Wy ENS (%y) £0. 


To this effect we start with a description of the function f(x,y) = 1 — ô(f (x, y)). This function has the follow- 
ing property f.(x,y) = 1 = f(x,y) 40, f(x,y) = 0 = f(x,y) = 0. It is easy to observe that now 
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TE dias 0 AyENf (x,y) = 0, 
l clX, -~ = 
ee TL J) {i Wy ENS (Ry) £0. 


Hence p,(x) = 1 — limo ofe(¥, J). We should indicate two points. The first: real recursive functions are 
closed under the product operation. It can be defined as an iteration of the function tp: Pr R 
ty(X,y, i) = (x, yf (x, i), i + 1), hence 


[lve =a, 1,0) 


The second: let us analyze the stage of y-hierarchy which contains p;(x) if f € Hj, where i € N is a given num- 
ber. The function f. is in Hj; and consequently by properties of an iteration |]'_of-(%,/) € His1. Finally, we 
can claim that py € H+. 

The same method is applicable to the general quantifier. In this way we can, once more, conclude that an 
uncomputable character of natural functions and relations given by quantifiers appear in the context which 
can be explained by real recursive functions with infinite limits. 

We can go back for a moment to accelerated Turing machines. It is a well-known fact that such machines 
could solve the halting problem. But, as we explained in the previous section, this possibility arises from the 
property of reaching infinite number of steps in finite time—this means that hypercomputable properties of 
accelerated Turing machines flow from infinite limits, too. 

In the light of the above considerations hypercomputation for analog devices has a strong connection with 
infinite limits. The use of infinite limits gives a possibility of an analysis for infinite number of cases in finite 
amount of resources (time, space, energy). Therefore, at this stage of our work we can present the uncontro- 
versial thesis: with infinite limits some hypercomputational properties are added to analog models of 
computation. 


6. Are limits physically possible? 


From the previous considerations we can deduce that for establishing the boundaries of practically realized 
models of computability, the nature of the material world becomes essential. It is important, however, to 
become aware of an obvious fact that we do not possess a direct knowledge of this quality of the Universe. 
That is why an analysis of its features and limits always takes place by means of physical theories. These the- 
ories become the only way to perceive quantitative relations that occur in the physical world. 

Therefore, we face the next boundary of our analysis. We cannot discuss ultimate boundaries of comput- 
ability but the limits of computability possibilities that result from a physical theory which is regarded as 
given. However, it may appear that such a far-reaching claim, namely the postulate of realizing infinity 
(energy, time) in some finite sector of physical reality is not acceptable to every physical theory. 

The fact that physical reality models does not exhibit super-Turing capabilities is claimed, for example, by 
Penrose. In [22] he stresses this point before he talks about the (non-computable) ultimate physical theory and 
the human mind: Now, where do we stand with regard to computability in classical theory? It is reasonable to 
guess that, with general relativity, the situation is not significantly different from that of special relativity—over 
and above the differences in causality and determinism that I have just been presenting. Where the future behavior 
of the physical system is determined from initial data, then this future behavior would seem (by similar reasoning 
to that I presented in the case of Newtonian theory) also to be computably determined by that data (apart from 
unhelpful type of non-computability encountered by Pour-El and Richards for the wave equation, as considered 
above—and which does not occur for smoothly varying data). Indeed, it is hard to see that in any of the physical 
theories that I have been discussing so far there can be any significant “non-computable” elements. 

But it occurs, though, that the above assumptions are not obvious. For more rigor we can restrict the con- 
siderations at least to commonly approved (not particularly exotic) physical theories. Two examples of phys- 
ical theories which can be seen as allowing hypercomputability will be presented at this moment. 

The first is Newtonian mechanics. In 19th century P. Painlevé together with H. Poincaré proposed a par- 
ticular analysis of a problem connected with the mechanics of heavenly bodies, that is the question of n-bodies. 
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In this system of n-bodies a solution of an equation system of movements for n gravitational interacting bodies 
is sought. P. Painlevé and H. Poincaré opened a discussion not about the way to discover a particular solution, 
but about an analysis of qualities of these solutions. There is a crucial question whether there may exist such 
solutions that contain a singularity. It is obvious that a situation of this kind happens when two, from all the 
described by the problem, bodies collide. Yet, the question arises whether the singularity may appear without 
any collision. The answer to this question was given by Xia [33] in 1992. He claimed that for a problem of five 
bodies in the three-dimensional space there exist non-collision solutions. The Xia answer causes throwing one 
of the bodies to infinity in finite time. As it can be seen, Newtonian mechanics allows finite realizations of 
infinity and potentially supports a possibility of calculations exceeding the limits of the Turing machine. 

Hence, we have reasons to believe that the n-body dynamics has hypercomputation capabilities and it is 
possible to explore them. Xia’s paper [33] showing that an infinite number of mechanical events can happen 
in finite time opens a way of thought. There is an open way to translate the halting problem into the n-body 
problem in classical mechanics: it is necessary to show that the subset of initial data that go off to infinity in 
finite time codes a universal machine. In Tipler’s book [32], he conjectured that universal initial data exists and 
it seems that the universal initial data is of measure zero in the space of all initial data. 

An obvious aim that appears at this moment is relating similar considerations to the physical theories that 
are regarded as currently valid (not as Newtonian mechanics). For this purpose we will use the theory of gen- 
eral relativity. There are such solutions of Einstein‘s equations in which there exist a time-like half-curve y as 
well as a point p in spacetime such that the entire stretch y is contained in the chronological past of p. Such 
spacetime structures (i.e., anti-de Sitter spacetimes) have been examined by physics with pointing out possible 
material systems that fulfill the required qualities (compare [8]). Moreover, the descriptions of the usage of 
such systems to create computing systems [28] have been proposed. Summing up, this theory, allows conduct- 
ing an infinite number of operations in finite time of an appropriate observer. 

From the point of view of analog computation, time is very important ingredient of such systems. Hence, 
the next element of this discussion will be devoted to a properties of time. Is time a continuous object or rather 
a discrete one? In our analog models it seems to be natural way of thinking, that variables (at least one of 
them) change in a continuous way in the time dimension of the Universe. This point is under discussion among 
experts. Some of them reject the continuous nature of time, others (see for example Newton-Smith in [20]) 
claim that on empirical grounds, continuous time is a better model for our Universe than discrete one. 

The above results do not entitle us to accept the thesis that hypercomputability is possible in our world. 
They show, however, that the possibility of crossing the Turing machine barriers is, in the light of some phys- 
ical theories, real. 

As we have observed, a new cognitive situation is introduced. The boundaries of computability become 
valid only for a stated physical theory. Moreover, they receive provisional and temporary character. When 
a physical theory regarded as the proper description of the Universe changes, there may occur a change in 
computability boundaries. The theory of computability gained additionally a relative character, this time in 
relation towards the physical theory assumed as a starting point in a construction of computing systems. 


7. Inner restrictions of analog computation with limits 


The previous parts of the paper can be seen as a claim that with a use of analog paradigm in computation 
equipped with limits we create a framework where all problems are solvable. Such result would be, of course, 
disappointing. An omnipotent system of computation would lose its constructive and algorithmic character. If 
all analytical functions (or moreover set-theoretical functions) would be computable, then a real meaning of 
computation would disappear. 

Because the system of real recursive functions was presented as very general, let us concentrate on it. Hence, 
here by undecidable problems we understand such problems which cannot be solved by real recursive func- 
tions. It may be observed, from the below results, that many important problems remain undecidable in this 
sense. 


Proposition 24 [17]. The problem of domain for real recursive functions is undecidable. 
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Proposition 25 [17]. The problem of identity of two real recursive functions given by their descriptions (coded 
into natural numbers) is undecidable by a real recursive function. 


We will say that a description is elegant if it has the property that no smaller description exists. We should 
then look at the size of descriptions, and, since they are written in characters, we can size them in quite dif- 
ferent ways. As with Chaitin’s elegant LISP programs (e.g., [4]) we cannot prove that a description is elegant. 

Let us assume some computable linear orders into the set of description numbers (i.e., into N). The exam- 
ples of such an order can be: m < n—the description number m codes a shorter description, or with same 
length but occurring lexicographically before the description of code n; m <;n—the order is lexicographical 
among the set of descriptions; m <, n—we compare the number of limits involved in the descriptions of codes 
m and n, then the number of differential recursions, then the number of compositions, in the case that all num- 
bers are equal we use the length, and later the lexicographical order. All mentioned linear orders are comput- 
able, i.e., they can be decided by classical recursive functions, hence by real recursive functions too. 


Proposition 26 [17]. The problem of minimal code is undecidable by real recursive functions. 


We give a corollary of the above proposition. In the case of the order <, some function M counts the min- 
imal number of limits needed to define a function given by some description. Since M is not real recursive, we 
can conclude that the problem of establishing the minimal level of the y-hierarchy (no matter the number of 
differential recursions and compositions) is not decidable in our framework. 

On the other side of such problems, we can analyze computability of some numbers. A real recursive 
number x is a real recursive function with arity zero (or an equivalent formulation states that there exists a 
unary real recursive function f : R — R with the property /(0) = x). The examples of real recursive numbers 
are the integers, but also the rationals, and the algebraic numbers (see [16] for a full proof). Transcendental 
numbers such as 2=4arctan(1) where arctan(0)=0, Oyarctan(x) = Pa Napier’s e=exp(1), Euler’s 
y = —lim,... {5 e* Inxdx, but also Chaitin’s halting probability Q are real recursive in different levels of the 
limit hierarchy. However, their number is countable. As analog quantities, these numbers are given once 
and for all as entire quantities (see [13]) and not as decimal expansions like in the case of the usual definition 
with Turing machines. 

A Rice-like general undecidability and incompleteness theorem for real-defined and real-valued functions— 
appear in the paper by da Costa and Doria [7], which was submitted for publication in October 1990 and com- 
mented by Stewart in Nature (see [31]) in August 1991. Similar results appear in the Ph.D. thesis of Moore 
({11, p. 119]) which was submitted to the Math Department in Cornell University in January 1991; those 
results had been obtained before December 1990. 

Herein we proceed to show how we can adapt the same results (their classical presentation can be found in 
[6]), namely Rice’s theorem, to the set of real recursive functions. We start with the real recursive variant of 
another classical result. 


Proposition 27 (The analog s-m-n theorem [17]). For each m,n > 1, there is the total real recursive (m + 1) — 


$ ` : Amtn — Ar 
ary function s, such that for integer numbers Xi, ..., Xm © Q X1; +++ 3Xm V15 -+ -3 Yn) = Domest) Vir + Vn): 


This leads us to the well-known and important Rice’s theorem in the context of analog computation. 


Proposition 28 (The analog Rice’s theorem [17]). Suppose that B is non-empty set of real recursive functions 
not coinciding with the whole class. Then the problem 2x. “h, € B” is undecidable. 


In other words, any property that real recursive functions can have, like being injective, or onto, or having 
an infinite domain, or having an infinite range, or being total, is undecidable unless it is trivial (corresponding 
to the empty set and to the set of all real recursive functions). Now, in terms of dynamical systems, these ques- 
tions concern basins of attraction. These basins are in general non-real recursive, i.e., there is no hyper-algo- 
rithm that will tell us whether or not a point is in them. In fact, we can even recall Theorem 10 from [12], which 
is proved by analog Rice’s theorem. 


Proposition 29 (Moore’s undecidability theorem [17]). The following questions about continuous-time dynamic 
systems are undecidable. 


116 J. Mycka | Applied Mathematics and Computation 178 (2006) 103—117 


1. Given a point x and an open set A, will x fall into A? 
2. Given a point x and a periodic point p, will x converge to p? Will a dense set of points converge to p? 
3. Is the set of periodic points on a given cylinder infinite? Dense? 


We think of a conceptual programming language that can be interpreted partially as analog circuits of a 
kind pioneered by Bush in 1930, and extended and speculated later by Rubel working on Shannon’s model 
of Bush’s Differential Analyzer. This programming language make use of limits, a mathematical concept that 
is not in general physically realizable. Thus (invoking informally the physical CT Thesis) such computational 
model is beyond the Turing limit, although functions remain constructible and countable in number. The 
hypercomputational character of the model has, however, nothing to do with the fact it handles real numbers 
and real numbers (as in [30]) can code for non-computable functions. The hypercomputational capabilities 
are associated with the operators, especially with the taking of limits. 

How powerful it is, this model suffers from the same classical limitations as the standard Turing model of 
computation: the classical results of computability theory can be parameterized to our programming language 
to show that, e.g., the halting problem of analog computation is not solvable. This is quite different from [30], 
since although real (but non-computable) numbers are incorporated in their model (as net weights), neural 
nets with real weights are not countable and thus the same diagonalization methods of classical computability 
can not be applied to a set of non-countable nets. Herein, we have the same s—m-n theorem and the same Rice’s 
theorem as in classical computability but with different interpretations. 


8. Conclusions 


Let us summarize the article with a few remarks concerning the relation between analog computation and 
hypercomputation. 

First, the use of real numbers does not lead automatically to a possibility of computations beyond Turing 
borders. We could observe that although GPAC is an analog device it can only find solutions to such problems 
which can be solved (approximately but with any desirable precision) by Turing machines [26] too. 

Next, the study of analog computation does not have to be inspired by hypercomputational motivation. 
There are good reasons to see analog computation as a useful tool of mathematics to study problems of clas- 
sical computability (with already obtained results in such fields as Grzegorczyk’s hierarchy [3,2]), complexity 
theory [19] and arithmetical hierarchy [18]. Moreover, there are some results which can compare analog com- 
putation with fields of mathematics (e.g., descriptive set theory [14]). Hence, the results for various models of 
analog computation should not be treated as the direct support for hypercomputation. 

However, it could be admitted that on some levels of analog computations (in the y-hierarchy [18] or, prob- 
ably, for EAC-computable functions [27]) we can find classically uncomputable functions. Let us point out 
that some tools for descriptions of such functions are also given in classical computability theory. Namely, 
the upper levels of the arithmetical hierarchy or degree theory consists of uncomputable, in Turing sense, func- 
tions [21]. So, it would be suggested that such wide and rich theories of analog computation do not speak 
about real possibility of computation, but form degrees of uncomputability by finding and classifying main 
uncomputable operators and structures. We believe that the current results give the strong support for the the- 
sis of an existence of natural connection between uncomputable character of some function and infinite limits 
involved (explicitly or implicitly) in its definition. 

Finally, we think that an important aspect of the discussions of hypercomputation is connected with phys- 
ics. Hence, the question about possibility of some computation beyond Turing limit is the question about nec- 
essary conditions for physical theories describing our Universe. In this aspect analog computation has some 
importance, as the theory closer in its formulation to physical theories than classical computability theory. 
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